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The area of progress testing has been neglected and 
has lagged far behind developments in language teaching 
and testing in general. In most classrooms today, English 
is taught through communicative textbooks that provide 
neither accompanying tests nor any guidance for test 
construction. Teachers are on their own in constructing 
tests to measure student progress and performance. The 
result is they write traditional grammar-based items in a 
discrete-point format that does not fit the communicative 
orientation of the textbook or the underlying teaching 
principles. 

In many cases, teachers have been reluctant to admin¬ 
ister regular tests. Stevenson and Riewe (1986) give the fol¬ 
lowing reasons for this: 

1. Teachers consider testing too time-consuming, taking 
away valuable class time. 

2. They identify testing with mathematics and statistics. 

3. They may think testing goes against humanistic ap¬ 
proaches to teaching. 

4. They have gotten little guidance in constructing tests in 
either pre-service or in-service training. 

Personally, I would add: 

5. Teachers feel that the time and effort they put into writ¬ 
ing and correcting tests is not acknowledged with ad¬ 
ditional pay or personal praise. 

6. There is the personal implication that I would call “the 
image in the mirror”: Testing puts you face-to-face with 
your own effectiveness as a teacher. In this sense, testing 
can be as frightening and frustrating to the teacher as it 
is for the students. 


Why Must Teachers Test? 

If we assume that a well-planned course should mea¬ 
sure the extent to which students have fulfilled course ob¬ 
jectives, then progress tests are a central part of the learning 
process. Other reasons for testing can be identified: 

1. Testing tells teachers what students can or cannot do— 
in other words, tests show teachers how successful their 
teaching has been. It provides washback for them to 
adjust and change course content and teaching styles 
where necessary. 

2. Testing tells students how well they are progressing. This 
may stimulate them to take learning more seriously. 

3. By identifying students’ strengths and weaknesses, test¬ 
ing can help identify areas for remedial work. 

4. Testing will help evaluate the effectiveness of the pro¬ 
gramme, coursebooks, materials, and methods. 

This continuous feedback provided by tests will ben¬ 
efit students, who will feel that their weaknesses are being 
properly diagnosed, and their needs met. 

Theoretical Considerations 

As the majority of teachers have not received enough 
training in test development, let me suggest a framework 
for the design of tests that fit with classroom activities. Let 
us start by defining progress tests as a measure of students’ 
progress towards definite goals. In this sense we do not make 
any distinction between progress or achievement tests: we 
conceive of both as one means for monitoring performance 
and evaluating the final outcome. 
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The second important issue is whether there is a dis¬ 
crepancy between teaching and testing. Weir (1990:14) 
has pointed out that the only difference between teach¬ 
ing and testing within the communicative paradigm re¬ 
lates to the amount of help that is available to the student 
from the teacher or his/her peers. Still there are some con¬ 
straints that the process of testing imposes, such as time, 
anxiety, grading, and competition. But, on the whole, we 
agree with Davies (1968:5) when he says that a good test 
is an obedient servant since it follows and apes teaching. 
Our tests should be based on the classroom experience 
in terms of syllabus, activities and criteria of assessment. 
Their final aim is to measure the language that students 
have learned or acquired in the classroom both recep¬ 
tively and productively. We could conclude by saying that 
the more our tests resemble the classroom, the more valid 
they will be. 

The theoretical requisites that a test must achieve are 
validity, reliability, and practicality. 

A test is valid if it measures what you want it to 
measure. 

Construct validity refers to the concomitance between 
the test and the underlying teaching principles. It follows 
from this that tests should reflect the objectives of the 
course and underlie its teaching principles. As regards com¬ 
municative testing, it is crucial that tests be as direct and 
authentic as possible; they should relate to real life and real 
communicative tasks. 

A progress test has content validity if it measures 
the contents of the syllabus and the skills specified in the 
coursebook. Hence, we should take into consideration the 
learners’ needs and their particular domain of use to en¬ 
sure content validity. Success with regard to this aspect is 
quite easy to achieve since the coursebook designer has de¬ 
cided on the course content. The task of the test writer—the 
teacher—is to sample this domain, measure it, score it, set 
up pass/fail cutoffs, and give grades. 

If a test is appealing to laymen—students, administra¬ 
tors, etc.—it has face validity. In other words, tests should 
be based on the contents of the textbook and the method¬ 
ological teaching approaches, as well as measuring what it 
is supposed to measure. 

Tests are reliable if their results are consistent, i.e., if ad¬ 
ministered to the same students on another occasion, they 
would obtain the same results. There are two main sources 
of reliability: the consistency of performance from candi¬ 
dates and scoring. 

Finally, a test has practicality if it does not involve 
much time or money in their construction, implementa¬ 
tion, and scoring. 


Planning Stage 

Specifications. Even if the specifications were done 
by the textbook writer, the teacher will have to select 
what s/he considers most important, and not what is 
easiest to test, in order to draw up a set of specifications 
which reflects the emphasis of the teaching (McGrath 
and Kennedy, 1979). Thus, in this stage, we aim at en¬ 
suring content validity which, as Anastasi (1982:131) 
defines it, is “essentially the systematic examination of 
the test content to determine whether it covers a rep¬ 
resentative sample of the behavioural domain to be 
measured.” 

As far as construct validity is concerned, there are cer¬ 
tain features of communicative language teaching that we 
should attain within the testing format: demand for con¬ 
text, information gap, unpredictability, authentic language, 
participant roles, emphasis on the message, integration of 
skills, emphasis on discourse, and real life situations. 

Two main implications may be drawn from these prin¬ 
ciples. The first is that we will have to concentrate both on 
use and usage. The second involves a reconsideration of the 
authenticity of texts and tasks. Authentic texts are not prob¬ 
lematic but the fact that tasks should be based on real life 
contexts may present difficulties. As Picket (1984:7) puts it: 
“By being a test, it is a special and formalised event distanced 
from real life and structured for a particular purpose. By defi¬ 
nition, it cannot be real life that it is probing.” In the same 
sense, Alderson (1981:57) states that the “pursuit of authen¬ 
ticity in our language test is the pursuit of a chimera.” 

But communicative testing is as communicative or 
non-communicative as communicative teaching, in so 
far as directness and authenticity of performance are al¬ 
ways restricted under classroom conditions. But, even if 
we admit that real life, authentic situations are not fully 
attainable, we should aim not to test how much of the lan¬ 
guage someone knows, but his ability to operate in a speci¬ 
fied sociolinguistic situation with specified ease or effect 
(Spolski, 1968:92). 

Sampling. Tests should cover the language, grammar, 
vocabulary, phonology, functions, and skill areas. Therefore, 
they have to cover both the content input and the activities or 
tasks. A test of communicative competence should test usage 
as well as the ability to use the language appropriately. If we 
want testing to accord with teaching, there should be a com¬ 
plete harmony between our teaching and our testing specifica¬ 
tions. We will test what we teach and in the same proportions. 

Development Stage 

In this stage we start the process of test design. I pro¬ 
pose the following guidelines for their construction: 
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1. Compile written and spoken source materials that fit 
the contents of the programme. As Carroll and Hall 
(1985:18) have stated, these inputs should be authentic, 
coherent, comprehensible, at a suitable level of difficul¬ 
ty, and of interest to learners. These materials can be ob¬ 
tained from newspapers, advertisements, leaflets, stories, 
etc. It is useful to group them under different themes 
and to identify the proficiency levels for which they are 
appropriate. 

2. Select activities that best measure performance. We 
should try to include all the possible activities used in 
the classroom. 

3. Select test format—multiple choice, true/false, gap fill¬ 
ing, etc.—taking into account channels, written or spo¬ 
ken, and strategy use. 

The selection of test format is fundamental and con¬ 
troversial. Carroll and Hall (1985) classify them into 
three categories: a) Closed-ended, b) Open-ended, and 
c) Restricted response. The first category is analytical and 
objective and should be used for the receptive skills of read¬ 
ing and listening. The second category, manifested in essay/ 
composition tests and interviews, is subjective, impression¬ 
istic, and global. The third category is content-controlled 
but may allow for more than one answer. 

4. Avoid items that are ambiguous, tricky, or overlapping. 
The difficulty should lie in the text and not in the ques¬ 
tion. For every item, teachers should be able to identify 
which strategy we want to tap into. All methods may 
be valid as long as they are well constructed, and their 
selection will depend on what is to be tested. The inclu¬ 
sion of as many methods as possible will palliate the 
negative effects of using just one. 

5. Include clear and unambiguous instructions, with brief 
and well-chosen wording and some examples. Weir 
(1993:24) recommends instructions to be candidate- 
friendly, comprehensive, explicit, brief, simple, and ac¬ 
cessible. 

6. Design a clear layout which will not induce mistakes. 
Make the test attractive, and similar to the layout of the 
textbook. We recommend variety, such as the use of pic¬ 
tures, different typefaces, and any element which can 
reduce anxiety. 

7. Thoughtfully consider the scoring and marking sys¬ 
tems. Testing is a teamwork activity not a solitary one. 
The marking system should be checked by at least an¬ 
other teacher. The marking criteria should be set before¬ 
hand and candidates must be informed as how they will 
be scored. 

There are two ways of marking: by counting and by 
judging (A. Pollit, 1990). The former is the objective pro¬ 


cedure in which the answers are either correct or incor¬ 
rect, mainly used for testing the receptive skills. The lat¬ 
ter is subjective and used for the productive skills. One 
way of making subjective, impressionist judgements more 
objective is to devise a marking scheme through bands 
and scales in which the judging criteria is described as 
precisely as possible. These bands should be made as 
simple and intelligible as possible (e.g., fluency, range of 
vocabulary, accuracy, appropriateness, etc.) so that scorers 
will not have to take into account too many aspects at the 
same time. 

8. Analyse the test statistically. Basic statistics are more 
straightforward than we imagine. Calculate the reliabil¬ 
ity coefficient—Kuder-Richardson—and the difficulty 
and discrimination coefficients. The first mathematical 
operation tells you how reliable a test is; the other two 
measures show if the items are at the right level of diffi¬ 
culty and how well they discriminate. These mathemat¬ 
ical operations are simple enough to be carried out in a 
manual calculator, and they can indicate the validity of 
the test and the performance of the examinee. 

9. Consider the pedagogical effects that the test may have 
on teaching. Morrow (1986) stated that the most im¬ 
portant validity of a test was that which would mea¬ 
sure how far the intended washback effect was actually 
realized. 

If we want our test to influence teaching and learning, 
we should ask our students and ourselves the following 
questions: 

• What do students think about the fairness of the 
test? 

• What poor results are due to poor item construc¬ 
tion? How could the items be improved? 

• What poor results are due to poor or insufficient 
teaching? 

• What poor results are due to the coursebook or 
other materials? 

• What areas of weakness in student performance 
have we detected for remedial work? 

• Can we make any assumptions on the relation be¬ 
tween teaching and learning? 

• What changes should be implemented in our 
classroom as a result of the test feedback? 

10. Present the test and feedback results to the students 
with the aim of reviewing and revising the teaching 
of content or skills in which the test has shown stu¬ 
dents to be weak. Teachers should listen to what stu¬ 
dents have to say about the test and profit from their 
comments. 
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Conclusion 

Teaching and testing are two inseparable aspects of the 
teachers task. In spite of the current reluctance to profit 
from the latter, this article contends that testing has an es¬ 
sential role in the development of students’ communicative 
competence. The brief nature of the article does not allow 
for an exhaustive description of progress testing. My inten¬ 
tion is to encourage teachers to read more on the subject 
and to try some of the suggestions given. 
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